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The topic treated is that of finding a reproducible, plausible and computationally simple method 
of selecting a discrete frequency distribution with prescribed upper and lower bounds on its com- 
ponents. The problem is shown to be tractable when a minimax error selection criterion is employed, 
and "error" is measured by maximum absolute deviation between components. In this case one obtains 
a linear program of a special form admitting explicit solution. The vertices of the polyhedron of optimal 
solutions can also be found explicitly, and so their centroid can be calculated if unique specification 
is required. 
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1 . Introduction 

In the mathematical modelling efforts associated with an operations research study, one may 
well have only incomplete information on which to base a representation of the probabilities of 
the various outcomes of some pertinent chance event. Under these circumstances, one should 
of course examine the consequences of several alternative probability distributions, each consistent 
with the information at hand. It still seems desirable, however, to have a systematic; and repro- 
ducible method for arriving at a single "nominal*' distribution, to serve as a base-point for such 
sensitivity analyses. 

This note works out the mathematics of one approach, based on a "minimax error" criterion, 
to the selection of a nominal distribution. The "incomplete information" is assumed to consist 
of upper and lower bounds on the individual terms of the probability distribution. 

Let L and U be real /i-vectors whose components satisfy 

0^Li<Ui^l. (1.1) 

A real ^-vector x will be called a probability vector if it has nonnegative entries which sum to 1. 
We will be concerned with the set P(L, U) of probability vectors x whose components satisfy 

Li^xi^Ui. (1.2) 

Our objective is to choose xe/ J (L, U) to minimize 

F(x)= max {<7(x, y) : yeP(L, U)} (1.3) 

where d is the metric on rc-space given by 

c/(x, y)= max/ 1 x— y\ | . (1.4) 
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It would be interesting to consider the problem with the alternate metrics 

flf(x,y)=2/fe-y l ) 2 , d(x,y)=2i|*i-yt| , (1.5) 

but this will not be done here. The common features of (1.4) and (1.5) are invariance under trans- 
lation—used in the next section — and convexity in y for fixed x. The latter property implies that 
the maximum in (1.3) occurs at an extreme point of P(L, U), and since the extreme points of this 
polyhedron can be found explicitly, F(x) can be written as a discrete extremum. Thus the remain- 
der of the problem — the minimization of F — has a strongly combinatorial flavor, but appears 
to be considerably harder for (1.5) than for (1.4). 

The solution method is derived and justified in sections 2-4. In general there will be a con- 
vex polyhedron of optimal x's rather than a single one; section 5 proposes the centroid of this 
polyhedron's vertices as a plausible "representative" choice, and shows how these vertices can 
be calculated. If they are not too numerous, they might perhaps provide the basis for the sort of 
sensitivity analysis mentioned above. Section 6 shows how the solution method extends to the 
generalization 

d(x, y) = max/w; | Xj — y; | 

of (1.4), where the w\ are given positive numbers. 

2. Simplification and Feasibility Analysis 

From (1.3) and the form of d, it is apparent that the constraint set F(L, U) can be replaced 
by any of its translates without changing the problem. Our first simplification is a translation 
through (— L), which replaces P(L, U) by the set 

<?(S, V) = {x:0 ^ Xi ^ Vi (all i\ £,*, = S} (2.1) 

where V = U — L > and S = 1 — 2,-L,-. Now (1.3) is replaced by 

F(x)=max{d(x,y):y€<?(S,V)}. (2.2) 

We turn next to a feasibility analysis, i.e., to determining when Q(S, V) will be nonempty. 
The condition 

0*S*%Vi (2.3) 

is obviously necessary; we will show it is also sufficient. If equality holds throughout (2.3), then 
clearly Q(S, V) = {0}. If equality does not hold, then (S/2,-K/)V is in Q(S, V). From now on we 
assume (2.3) holds, in fact that 

< S < XiVu (2.4) 

since otherwise Q(S, V) is a single point and the whole problem is trivial. 

3. Evaluation of F 

F(x), as given by (1.4) and (2.2), is readily evaluated in terms of the quantities 

M*=max{yr.y€<?(S,V)}, (3.1) 

rm= min {n:yeQ(S, V)}. (3.2) 

Indeed, we have 

F(x)= max y max/ max {y, — %u x\ — yi} = maxj max {max y (yi— Xi) , max y <>; — y,)} 
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or finally 

F(x) = max, max {Mf— Xi, %\ — m,-}. (3.3) 

We next find explicit expressions for M\ and m,-, so that (3.3) is also explicit. It will be shown 
that 

Af,= min {V u S}, (3.4) 

m,= max {(), 5 -Xj^tVj}. (3.5) 

If Mf and mf denote the right-hand sides of (3.4) and (3.5), then clearly any yeQ(S, V) satisfies 
mf^yi^Mf. It suffices to show that y t = Mf for some yeQ(S, V), and that yi = mf for some 
yeQ(S,\). 

For the first purpose, if V\ ^ S we note from (2.4) that 

o*o=$-Vi)& J «Vj<i, 

and set 

US< V u we set 

y\ = S , jj i = for / 7^ / . 

For the second purpose, if S ^ Xj^iVj we set 

y,- = S — SjwFj, y'j = Vj for 7 ^ i. 

If 5 < Zj^iVj we set 

y» = 0, W =KjS/X M F*for;*i\ 

This completes the proof of (3.4) and (3.5). 

We now make a second simplification, namely translation of the constraint set Q(S, V) , through 
(— m) where m is the vector with components m x . The result is a new constraint set Q(S\ V), where 

However, the primes will be dropped. We now have all m-, — 0, so that 

F(x)=max,{M t - -*,,*,}, (3.6) 

S^XfriVj (alii). (3.7) 

Note that (3.4) still holds. 

4. Minimization of F 

The minimization of F over Q(S, V) can be viewed as a linear program, namely to select 
z and x so as to minimize z 9 subject to xe(?(S, V) and to 

z^ Mi-xr, z**x\ (all i). 
265 

321-453 OL-69— 2 



These last constraints are equivalent to 

Mi—Z^Xi ^2, 

so that the linear program's full set of constraints reads 

max {0, Mi — z] ^ x\ ^ min {z, V t } (all £), (4.1) 

%Xi = S. (4.2) 

For fixed z, the existence of an x satisfying (4.1) and (4.2) clearly implies that 

Si max {0, Mi-z) ^ S ^ 2i min {z, Fi}, (4.3) 

z 55 i max, M,- > 0. (4.4) 

We now show that the converse also holds. Note first that (3.4) and (4.4) yield 

Vt*Mi>Mi-z 9 
which together with (4.4) yields 

max {0, Mt-z} ^ min {z, Vi] (all i). (4.5) 

If equality holds in the second part of (4.3), then (4.1) and (4.2) are satisfied by taking 

Xi = min {z, Vi} (all i). 
If strict inequality holds, then k : = n has the property 

2j* k min {z, Vj} + % j>k max {0, M } -z}>S, (4.6) 

but A;=0 does not, and so there is a smallest ke{\, 2, . . ., n} with this property; for that k, 

l j<k min {z, Vj}+Xj* k max {0, Mj-z} ^ S. (4.7) 

We now set 

Xj = min {z, fj} (all j < k) , 

ij=max {0, Mj-z} (ally > A), 

that (4.1) is satisfied for i = A: follows from (4.6) and (4.7). 

The problem has now been reduced to minimizing z subject to (4.3) and (4.4). For this pur- 
pose, renumber so that 

V x 2* V 2 z* . . . ^ V n > V n + i><= 0, (4.8) 

which by (3.4) implies 

M, ^ M 2 ^ . . . ^ M w > M„+, = 0. (4.9) 
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If z* is the minimum value of z > satisfying the first half of (4.3), 

St max {0, Mi-z}^S, (4.10) 

and z** is the minimum value of z > satisfying the second half, 

2*min{z, Vi) ^S, (4.11) 

then the desired minimum value of z is 

z min = max {z*, z**, £ min {S, F,}}- (4.12) 

Thus it suffices to determine z* and z**. 

The determination of z* goes as follows. Let 

Mf=X\M t -jMj. (4.13) 

Then A/,*= < S, and by (2.4) we have M* +1 ^ 5. Moreover, the calculation 

shows that the sequence {A/*}[ t+1 is nondecreasing. Thus there is a unique ,/e{ 1 , 2, . . ., ;?} such 
that 

= M? ** M 2 * ^ . . . ^ A/? < S ^ /Wj* +I ^ . . . ^ M* +1 . (4.14) 

Now if 0<z<M/+i, then 

2,max{0, /^,.- 2 }^2/ +1 ^-(y+l)z>M; +1 2*S, 

so that z does not satisfy (4.10). And if Mj^ z ^ /W,+ , , then (4.10) becomes 

%{Mi-Jz^S, (4.15) 



which is equivalent to 



z^z*=ff 1 M i -S)/y. (4.16) 



By use of (4.14), the value of z* proposed in (4.16) is easily verified to satisfy M., ^ z* ^ M/+i, and 
so is indeed the smallest z > satisfying (4.10). 
The determination of z** goes as follows. Let 

Vt*=kK+l% +1 Vi. (4.17) 

Then by (2.4), we have Vf* >S, and 0= V** t < S. Also, the calculation 

V** 1 -Vt* = k(V k+ i-V k )^0 

shows that the sequence {^**}i l+1 is nonincreasing. Thus there is a unique Ke{\ , 2, . . . , n} 
such that 

V* * ^ V%* ^ . . . ^ F** 2* S > F**j ^ . . . ^ F**!. (4.18) 

Now if z^ F A + 1 , then 

2i min {z, Vi} *S (K+l)z + X n K+2 Vi ^ V** t < S, 
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so thatz does not satisfy (4.11). And if V h • 3* z > Vk+i, then (4.11) becomes 

which is equivalent to 

z^z**=(S-X n K+1 Vi)IK. (4.19) 

By use of (4.18), the value of z** proposed in (4.19) is easily verified to satisfy V K ^ z** > Pff+i, 
and so is indeed the smallest z > satisfying (4.11). 

The process for finding K, and thus z**, can be shortened as follows. First observe that the 
constraint set Q(S, V) can clearly be replaced by Q(S, M), where the components Mi of M are 
given by (3.4). Thus V k 's are replaced by M k % and FJ*'s by Mf's. From (4.13) and (4.17) we 
have 

Mf+Mf* = %<}Mu 

so that (4.18) is equivalent to 

and K can be evaluated using the same sequence {M*}j used to locate./. This sequence can be 
generated using the initial condition Mf = and the recursion 

Mf +i = Mf+j(Mj-M J+l ). 

To conclude this section, we recapitulate the solution process developed above. The input 
data are the n-vectors L and U, satisfying =^ L < U. (If some Li= [/,-, we set %i= Li, drop the ith 
component from consideration, and rescale x by (1 — L/) _1 .) 

Step 1 : Set V% = U t - L, for 1 ^ i ; ^ n. Set S = 1 - XiU 

Step 2: If S < OorS> 2/F/, STOP; the problem is infeasible. If S = set x= and go to Step 
10; i£S = XiVt setx = V and go to Step 10. 

Step 3: Form the vector m with conponents m, = max {0,S — Hj^iVj}. Replace V by V — m, 
and S by S — X\rrii. 

Step 4: Renumber the components of Y to be in nonincreasing order. Record the correspond- 
ing permutation 77 of {1, 2, . . ., n}. Set V n +\ = 0. 

STEP 5: Calculate M t = min {V u S} for 1 ^ i ^ n+ 1. 

STEP 6: Calculate Mf, from the initial condition Mf = and the recursion Mf +l = Mf 
+j(Mj — Mj+\), until a first one M* +1 is reached which is ^ S and a first one M% +x is reached which 
is>2fM l -S. Setz*=(2/M l -S)//and2**=(S-2g +1 Af l )//iC. 

Step 7: Form z = max {z*, z**; 2^1}. (This corresponds to the z min of the previous text.) 

Step 8: (Assumes any optimal x will do.) Calculate S* 9 from the initial condition S* = 2{ 1 min 
{z, Vi} and the backwards recursion 

S*- i=S* + max {0, M,-z}-min{z, F}}, 
until a first one S*_i is reached which is ^ S. Define x by 

Xj= min {z, F}} (all) < k) , 

jcj=max {0, Mj-z} (all;> A), 

Xk = & ^j *=k %j • 

STEP 9: Permute the components of x by 7r _1 . Then replace x byx + m. 
Step 10: Replace xbyx+L. 
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5. The Centroid Solution 

Once z min has been found, the optimal x's are denned by the constraints (4.1) and (4.2), which 
we repeat here, 

XiXi = S, (5.1) 

a\ ^ Xi ^ bi (all i) (5.2) 

where a/ = max{0, M\ — z min } and bi= mm {z min , Vt} . One member of this convex polyhedron of 
solutions can be found by the construction used to show that (4.3) and (4.4) implied the existence 
of a solution to (4.1) and (4.2). But this is somewhat arbitrary. In view of the original intention to 
fasten on a single x, it seems less arbitrary (at least to the writers) to select the centroid of the 
vertices of the polyhedron. Fortunately, these extreme points can be found explicitly. In what 
follows we assume 

2 j a; < S < Xibi, 

thus excluding the trivial cases in which the polyhedron degenerates to a single point. 

The polyhedron lies in the (n — l)-dimensional hyperplane (5.1); its extreme points are char- 
acterized as intersections of (5.1) with some /i — 1 of the 2n "bounding hyperplanes" x\ — a x and 
Xi= bt. Such a point of intersection, x(/,^), is associated to eachyejl, . . ., n} and each of the 
2" -1 subsets^ of {1,2,. . ., n} — {j}. The coordinates of il(j, A) are given by 

Xi = (ii ieA, 

%i=bi /e{l,2,. . ,,n} — {j}—A, 

Xj O 2*i j6jX j . 

The extreme points of the polyhedron are precisely those x(j\A) for which 

<tj ^ xj ^ bj. 

6. The Weighted Version 

We now generalize the objective function (1.3) to 

F(x) = max{maxttt;t|%t — y,| : yeP(L, U)} (6.1) 

where {wi}" is a set of positive "weights" with %iWi=\. This corresponds to the case in which 
the accuracy, with which x approximates the "true" distribution, is more important for some 
components than for others. 

The reasoning of sections 2 and 3 go through unchanged, with occasional insertions of "w," 
in appropriate formulas. We find that (4.1) is replaced by 

max {(), Mj-z/wi} ^ x } ^ min {z/w u Vi} (all i) (6.2) 

so that (4.3) and (4.4) are replaced by 

S, max {0, Mi-z/wi} ^S^Xi min {z/w u Vi}, (6.3) 
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z 2= i msiXiMiWi. (6.4) 

The problem is now that of minimizing z subject to (6.3) and (6.4). As before, we write 

z min = max {z*, z**, i max/M,^ } , (6.5) 

where now z* is the minimum value of z ^ satisfying 

It max {0, Mi-z/wi} ^ S (6.6) 

and z** is the minimum value of z ^ satisfying 

li mm {zlwi,Vi}^S. (6.7) 

The renumbering now is to be such that 

VxWx 2* F 2 W2 ^ . . ^ F n W„ > (6.8) 

which by (3.1) implies a similar condition for {MtWi}^. As before we set V n + \ = (implying Af n +i = 0), 
and now also choose any w n +i > 0. 

The determination of z* goes as follows. Let 

Mf = X{Mi - wjMjXKHwi) . 

Then Mf = < S, and by (2.4) we have M* + , ^ S. The calculation 

M.* i -M*=(^ j M j -^ +1 M j+1 )2/(l/^)^0 

shows that sequence {Mf}^ + X is nondecreasing. Thus there is a unique Je{l, 2, . . ., n} such that 

= M* ^ M* ^ . . . ^ Mf < S ^ flfji, ^ . . . ^ M* +l . (6.9) 

Now if < z < Mj+iWj+i , then 

Si max {0, Mi-z/wi} ^ %{ +1 (Mi-zlwi) > M* +l 2* S, 

so that z does not satisfy (6.6). And \iMjWj ^ z ^ Mj+tWj+i, then (6.6) becomes 

liWi-zlunysS, 

which is equivalent to 

z^z*=(XiMi-S)IXi(llwi). (6.10) 

By use of (6.9), the value of z* proposed in (6.10) is easily verified to satisfy MjWj ^ z* ^ M J+ \Wj+\, 
and so is indeed the smallest z > satisfying (6.6). 
The determination of z** is similar, involving 

v**=w k v k $*aiw)+x% +l Vu 

V** ^V****. . .^V**^S> VS* t ^ . . . ^ K* +1 , 
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= (S-2j +1 K,)/Sf(V»i). 



(6.11) 
(Paper 72A4-276) 
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